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CHAPTER  I 


ENVIRONMENT  OF  THE  STUDY 

The  Air  Force  Institute  of  Technology  (AFIT) , a 
component  of  Air  University,  provides  education  and 
training1  to  meet  United  States  Air  Force  (USAF)  needs  in 
scientific,  technological,  managerial,  medical,  and  other 
areas  directed  by  USAF  Headquarters  (55:2-3). 2 The  AFIT 
School  of  Systems  and  Logistics  conducts  two  programs  to 
meet  these  requirements : a Graduate  Management  Program 

(courses  leading  to  a Master  of  Science  degree)  and  a 
Continuing  Education  Program  (short  courses  not  leading 
to  a degree) . The  degree  programs  provide  an  educational 
background  to  selected  Department  of  Defense  (DOD)  per- 
sonnel to  enable  them  to  " . . . understand  their  cultural 

and  technical  environment  and  to  analyze  and  attempt  to 
solve  its  problems  [59:4]." 

AFIT's  School  of  Systems  and  Logistics  provides 
educational  programs  in  systems  and  logistics  management 

Education  and  training  will  be  used  synonymously. 
References  to  vocational,  apprentice,  or  other  forms  of 
training  which  are  not  part  of  an  accredited,  degree 
granting  program  will  be  specifically  defined. 

Scientific  citation  is  used  throughout  this  paper 
The  bibliographical  number  of  the  source,  a colon,  and  the 
page  number (s)  are  enclosed  within  parentheses  or  brackets 
Citations  for  more  than  one  reference  are  separated  by  a 
semicolon . 
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to  meet  the  requirements  of  the  USAF  and  DOD.  The  Graduate 
Management  Program  is  designed  to  develop  executive  capa- 
bilities of  military  logisticians  for  eventual  assignment 
to  key  positions  throughout  the  military  departments. 
Graduates  of  this  twelve  month  accredited  educational 
program  are  awarded  the  degree  of  Master  of  Science  in 
Logistics  Management,  in  Logistics  Management  with  a 
Procurement  major,  or  in  Facilities  Management. 

The  graduate  management  curriculum  is  designed  to 
meet  DOD  requirements  by  providing  courses  of  study  which 
establish  a solid  foundation  for  logistics  decisions.  The 
courses  provide  a unique  integration  of  management  theory 
and  analytical  techniques  specifically  related  to  logis- 
tics applications.  The  curriculum 

. . . achieves  a balanced  presentation  of  quanti- 
tative and  qualitative  oriented  course [s],  created  to 
meet  the  specific  needs  of  military  logisticians  by 
providing  a broad  knowledge  of  military  systems,  logis- 
tics economics,  and  the  management  of  human,  material, 
and  fiscal  resources  [3:13]. 

Although  the  curriculum  has  been  accepted  for  its 
relevance  to  the  complex  DOD  logistics  management  problems, 
it  remains  the  subject  of  continuing  development  efforts 
(5;  6;  60).  This  research  effort  is  an  attempt  to  apply 
the  current  USAF  Instructional  System  Development  (ISD)  3 
to  the  logistics  management  curriculum. 

3AF  Manual  50-2,  Instructional  System  Development 

(61 : Atch. 1 ,p. 3)  defines  ISD  as: 

"A  deliberate  and  orderly  process  for  planning  and 
developing  instructional  programs  which  ensure  that 
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Background  of  the  Problem 

Since  introduction  of  the  first  major  USAF  ISD 
system,  the  application  of  advanced  curriculum  design 
techniques  has  structured  technical  training  courses 
using  systems  management  methods  (22).  Current  USAF 
policy  requires  application  of  ISD  techniques  to  existing 
instructional  systems;  the  goals  of  instructional  systems 
must  be  directly  related  to  USAF  requirements  (61  :Ch.l,p. 1) . 

The  first  step  in  planning  and  developing  an 
instructional  system  is  the  analysis  of  requirements 
of  the  operational  system  involved  [61 ;Ch. 2 ,p. 1 ] . 

The  USAF  policy  statement  explicitly  requires  application 

of  ISD  techniques  to  the  "full  spectrum  of  education 

and  training,"  but  does  not  provide  specific  guidance  for 

application  of  ISD  to  knowledges  and  attitudes. 

Statement  of  the  Problem 

USAF  policy  requires  that  ISD  be  applied  to  exist- 
ing instructional  systems.  Although  ISD  techniques  may 
have  been  applied  implicitly,  there  is  no  evidence  of 
a documented,  comprehensive  application  of  the  ISD  process 
within  the  AFIT  School  of  Systems  and  Logistics.  The 
procedures  and  techniques  for  applying  ISD  within  a gradu- 
ate education  environment  have  not  yet  been  validated.  The 
first  step  of  the  ISD  Model  requires  identification  of  the 
educational  needs  of  the  operational  system.  Air  Force 

personnel  are  taught  the  knowledges,  skills,  and 
attitudes  essential  for  successful  job  performance." 
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Manual  (AFM)  50-2  (61),  Instructional  System  Development, 

indicates  that  educational  needs  can  be  determined  through 
goal  analysis;  however,  goal  analysis  techniques  were  not 
addressed  in  AFM  50-2  and  the  educational  needs  of  the 
operational  system  are  unknown. 

Scope 

The  scope  of  this  research  will  be  limited  to 
application  of  the  first  step  of  the  USAF  ISD  Model — 
determine  needs  of  the  operational  system.  The  study  will 
be  concerned  with  educational  needs  for  the  AFIT  School 
of  Systems  and  Logistics,  Graudate  Logistics  Management 
Program.  The  problem  will  be  further  limited  to  the 
financial  management  needs  of  USAF  officer  positions  which 
require  graduates  of  the  AFIT  Graduate  Management  Program, 
hereafter  referred  to  as  Graduate  Logistics  (GL)  positions. 

Justification  of  the  Research 
Efficient  Resource  Management 

In  a recent  analysis  of  managerial  research, 

Campbell  found  that: 

. . . training  cost  has  risen  to  the  point  where, 
along  with  the  cost  of  salaries  and  materials,  it  has 
come  to  represent  one  of  the  major  investments  of 
financial  resources  made  by  organizations  [9:40]. 

The  study  also  found  that  most  of  the  training  effort 

was  applied  to  management  training  and  development  in  the 

hope  that  managers  would  improve  their  job  performance  and 

become  better  prepared  for  more  responsible  positions  (9:45). 
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The  USAF's  need  for  effective  managers  capable  of  promotion 
to  top  management  positions  is  driven  by  the  same  economic 
factors  motivating  private  industry  (3:9).  In  fact,  the 
magnitude  of  defense  spending  and  the  criticality  of 
national  defense  can  make  the  need  for  high  quality 
management  a national  issue.  For  example,  the  replace- 
ment of  James  Schlesinger  as  Secretary  of  Defense  and  the 
ensuing  public  debate  documented  in  both  the  electronic 
and  printed  media  (34:2)  emphasized  the  management  of 
defense  spending  as  a national  issue. 

The  pervasive  nature  of  USAF  logistics  functions 
and  the  magnitude  of  logistics  expenditures  create  an 
important  potential  for  savings  recognized  by  Headquarters 
USAF  logistics  planners. 

In  view  of  the  magnitude  of  resources  controlled 
by  the  various  logistics  disciplines,  and  ever 
increasing  demands  to  do  more  with  less,  it  is  imper- 
ative that  an  adequate  reservoir  of  qualified  officer 
logisticians  be  developed  to  meet  future  needs.  This 
can  best  be  accomplished  by  determining  experience 
and  education  and  training  requirements  . . . 

[57 :Part  II, p. 25] . 

In  addition,  DOD  logistics  planners  assume  that  increased 
technical  competence  will  be  required  of  future  logistics 
managers  (64 :Ch. 2 ,pp. 2-3) . 

Effective  Logistics 
Management  Education 

USAF  sponsored  graduate  education  has  received 
increasing  and  detailed  evaluation  by  congressional 
investigators  seeking  to  insure  that  educational  programs 
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ara  receiving  effective  management  (21:61;  46:19). 

Specific  details  of  defense  spending  changes  are  difficult 
to  predict,  but  DOD  logistics  planners  assume  that  calls 
for  increased  efficiency  and  more  effective  management 
will  increase  in  intensity  and  lead  to  more  stringent 
budget  constraints  (64 :Ch . 2 ,p . 2 ) . 

Several  studies  have  documented  the  scope  and 
increased  managerial  effectiveness  which  the  USAF  derives 
from  sponsoring  graduate  logistics  management  education 
(4;  10;  17;  27;  31;  49). 

Private  industries'  need  for  more  effective 
managers  is  recognized  by  developers  of  logistics  cur- 
ricula for  graduate  business  schools  (11:6).  However, 
the  development  of  undergraduate  and  graduate  logistics 
curricula  in  civilian  institutions  follows  a pattern 
of  evolution  and  change  which  has  been  hampered  by  the 
nature  of  managerial  work  and  the  lack  of  effective  means 
to  evaluate  training  effectiveness  (9:271-320).  Gordon 
and  Howell  summarize  the  business  curriculum  development 
dilemma  as  follows: 

It  is  probably  safe  to  say  that  in  no  other  area 
of  professional  education  ...  is  there  so  much 
uncertainty  as  to  what  constitutes  a proper  educational 
background  for  professional  practice  or  are  existing 
educational  standards  and  practices  viewed  with 
greater  skepticism  [23:6], 

I 

The  potential  benefits  of  better  educated  managers  lend 
an  intuitive  appeal  for  research  which  will  enable  develop- 


ment of  more  effective  curricula. 
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Effective  Management  Education 

Numerous  studies  have  been  called  for  effective 
determination  of  management  training  needs  (11;  18;  23; 

25;  33;  35;  36;  37;  45).  However,  the  authors  could 
locate  no  documentation  of  attempts  to  apply  a systems 
approach  or  a definitive  educational  needs  determination 
in  either  an  undergraduate  or  graduate  business  logistics 
environment.  Cherington  and  Schneider  emphasized  the 
logistics  curriculum  problem  by  stating; 

. . . others  [teachers]  may  use  their  intuition 

or  rely  simply  on  available  text  books.  Each  teacher 
must  determine  for  himself  the  objectives  of  his 
logistics  . . . courses  within  the  context  of  his 
school’s  orientation  [11:101]. 

Campbell  cited  Gagne  (19)  and  six  other  studies 
in  the  needs  determination  area  but,  "almost  no  substan- 
tive studies  have  been  published  in  this  area.  ..." 
Further,  Campbell  was  "...  able  to  find  no  example  of  a 
task  analysis  even  approaching  the  scope  demanded  by 
Gagne's  schema  . . ."in  the  managerial  training  or 
educational  areas  (9:260).  The  Campbell  study  goes  on  to 
assert  that  they  were  surprised  ".  . .by  the  extremely 
limited  nature  of  training  studies  done  thus  far,"  and 
recognized  that  "...  the  question  of  training,  or 
'what  should  be  taught,'  is  crucial  [9:481]." 

The  determination  of  educational  and  training 
needs  required  by  the  USAF  ISD  Model  ( 61 : Ch . 1 , p . 3 ) hinges 
on  task  analysis — another  area  of  academic  interest.  Task 
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analysis4  in  managerial  areas  has  not  been  well  documented 
although  task  analysis 


. . . is  an  essential  step  in  performance,  descrip- 
tions and  evaluation,  selection,  training,  and  organi- 
zational studies.  However,  relatively  few  studies 
have  been  performed  which  extend  or  apply  the  results 
of  broad  task  analysis  studies  [47:388-89]. 

A Headquarters  USAF  planner  estimated  that  a more  accurate 

educational  needs  determination  would  benefit  manpower, 

personnel,  and  education  planners  (26).  In  addition,  the 

Chairman  of  the  AFIT  School  of  Systems  and  Logistics 

Academic  Affairs  Committee  agreed  that  educational  needs 

determination  is  directly  applicable  in  courses  in  the  GL 

management  curriculum  (5) . 

In  summary,  the  justification  for  this  research 
effort  is  found  in  four  major  areas: 

1.  Application  of  the  USAF  ISD  Model  is  required, 
but  has  not  been  documented. 

2.  The  critical  need  for  logisticians  who  can 
effectively  manage  defense  resources. 

3.  The  need  for  more  effective  USAF  education 
programs . 

4.  The  lack  of  studies  and  research  in  the  educa- 
tional needs  determination  area. 

4Task  analysis  is  a specific  and  detailed  examina- 
tion of  job  activities. 
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Objectives 


The  purpose  of  this  research  effort  is  to  conform 
with  USAF  ISD  policy  by  applying  the  first  step  of  the 
ISD  Model  to  determine  the  financial  management  needs  of 
GL  coded  positions.  The  first  objective  of  this  study 
will  be  to  verify  that  goal  analysis  can  be  used  to 
identify  the  financial  management  techniques  required 
in  GL  coded  positions.  The  second  objective  will  be 
to  apply  goal  analysis  to  determine  the  financial  manage- 
ment techniques  needed  for  GL  coded  positions,  and, 
therefore  comply  with  USAF  ISD  policy. 

Research  Questions 

1.  Can  goal  analysis  be  used  to  identify  financial 
management  techniques  required  for  GL  positions? 

2.  If  goal  analysis  can  be  used  to  identify  finan- 
cial management  techniques,  what  financial  management  tech- 
niques are  required  for  GL  positions? 


CHAPTER  II 


LITERATURE  REVIEW 

An  examination  of  a general  systems  approach  pro- 
vides the  perspective  needed  to  follow  the  development 
of  educational  models.  The  systems  approach  has  been 
used  to  model  the  educational  process  with  varying  degrees 
of  sophistication.  An  Early  Model,  the  Spiral  Model, 
the  Warren  Model,  and  the  Mature  Systems  Model  will  be 
examined  along  with  task  analysis,  goal  analysis,  and  job 
analysis  as  background  for  the  USAF  ISD  Model. 

Systems  Approach 

The  systems  approach  can  be  described  as: 

A systematic  approach  to  helping  a decision-maker 
choose  a course  of  action  by  integrating  his  full 
problem,  searching  out  objectives  and  alternatives, 
and  comparing  them  in  the  light  of  their  consequences, 
using  an  appropriate  framework — in  so  far  as  possible 
analytic — to  bring  expert  judgment  and  intuition  to 
bear  on  the  problem  [16:188]. 

In  other  words,  the  systems  approach  leads  to  logical 

analysis  of  critical  factors  affecting  the  organization 

(32:462-63) . 

Educational  systems  models,  discussed  in  a later 
section  of  the  literature  review,  are  open  systems  which 
accept  feedback  from  interaction  with  their  environment. 
Feedback  can  be  thought  of  as  information  used  to  alter  the 


10 


11 


system's  methodology  of  affecting  goals.  Feedback  can 
either  be  negative  and  have  a degenerative  effect  or 
positive  and  be  reenforcing  in  nature.  For  example,  a 
manufacturing  process  would  use  negative  feedback  to 
regulate  the  quality  of  its  product  and  positive  feedback 
to  adjust  the  quantity  produced.  Managers  at  all  levels 
of  open  systems  receive  feedback  from  both  the  environment 
and  internal  sources,  interpret  the  feedback,  and  apply 
corrective  measures  to  regulate  system  operations.  The 
systems  approach  involves: 

1.  Defining  the  system  by  establishing  bounda- 
ries . 


2.  Stating  the  goals  of  the  system  in  explicit 

terms . 


3.  Determining  the  constraints  of  the  system. 

4.  Establishing  alternative  courses  of  action. 

5.  Testing  the  alternatives  with  system  con- 
straints and  goals  as  criteria. 

6.  Implementing  the  system5  (30:85-95;  67:36-40). 


The  systems  approach  should  not  be  considered  as  a check- 
list, but  . .a  way  of  thinking — a perspective  that 
emphasizes  relationships  and  interactions  [13:84]." 

5These  steps  are  not  all  inclusive. 
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Educational  Systems  Models 

The  acceptance  of  the  systems  approach  to  manage- 
ment in  the  aerospace  industry  was  paralleled  by  increased 
interest  in  a systems  approach  to  management  training  and 
curriculum  development  (19;  61). 

An  Early  Model 

Robert  Gagne  introduced  the  use  of  psychological 
principles  in  the  development  of  training  curricula,  but 
used  only  the  segment  of  systems  theory  concerned  with 
man-machine  interface  (e.g. , the  technical  training  of 
radar  system  operators).  Gagne's  book.  Psychological 
Principles  in  System  Development,  was  introduced  by 
Arthur  W.  Melton  as  the  first  of  its  kind.  The  applica- 
tion of  the  systems  approach  to  training  marked 

. . . the  coming  of  age  of  a systematic  conception 

of  the  application  of  psychological  principles  . . . 
to  the  human  component  or  components  in  a system 
[19 :v] . 

Educators  have  since  adopted  a more  comprehensive  applica- 
tion of  the  systems  approach. 

A major  aim  of  the  systems  approach  to  academic 
planning  is  to  create  educational  settings  which  are 
responsive  to  the  emerging  needs  of  students  and  of 
the  society  [43:9]. 
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the  organization  in  an  ongoing  "continuous  spiral  feed- 
back system  [35:13]."  The  training  process  is  divided 
into  three  phases:  (1)  pretraining,  in  which  the  organ- 

ization's motivation  and  needs  for  training  are  docu- 
mented, (2)  the  training  phase,  in  which  behaviors  are 
modified,  and  (3)  the  post-training  phase,  in  which  the 
individual  attempts  to  apply  newly  learned  behaviors 
(35:19-23) . 

Lynton  and  Pareek's  first  phase  of  the  training 
process  examines  training  needs  in  detail.  In  a rigorous 
job  analysis  the  technical  needs  of  the  job,  personal 
interaction,  the  pressures  of  the  job,  and  variability  of 
the  quantity  and  time  frame  of  work  should  all  receive 
intensive  attention.  They  recognize  that  training  require- 
ments are  driven  by  the  needs  of  the  job.  A multi- 
disciplinary approach,  in  which  the  training  staff  actively 
works  with  functional  specialists,  is  more  effective  than 
a conventional  approach.  The  designers  of  this  model 
state  that  training  institutions  cannot  adequ  uly  define 
training  needs  (35:77-78).  Major  emphasis  was  given  to 
".  . . the  crucial  requirements  of  the  job  . . . that 
make  the  difference  between  effective  and  ineffective 
performance  [35:85].”  Their  diagnostic  approach  uses  a 
"critical  incident  technique"  which  specifies  "knowledge 
and  skill  content,  relationships  involved,  time  spans, 
and  settings  and  roles  [35:85]."  The  Spiral  Model  provides 


a conceptual  framework  for  the  systems  approach,  but 
offers  little  practical  guidance  for  educational  needs 
determination  in  a graduate  education  environment. 
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The  Warren  Model 

Warren  also  applied  the  systems  approach  and 
developed  a model  with  five  elements — research,  analysis, 
development,  operations,  and  evaluation  (65:86).  The 
research  element  provides  data  which  are  used  in  the 
analysis  element  to  identify  training  needs  and  evaluate 
the  effectiveness  of  the  training  system.  The  develop- 
ment element  generates  specific  training  programs  designed 
to  meet  organization  objectives.  The  operations  element 
conducts  the  training  and  administers  the  program  on  a 
daily  basis.  The  last  element,  evaluation,  examines 
".  . . training  system  efficiency  [65:28-29]."  Warren 
emphasized  the  importance  of  training  needs  determination 
for  the  design  of  training  programs  and  for  evaluation 
of  training  effectiveness  (65:47).  Training  needs  are 
developed  by  the  analysis  of  three  types  of  data: 

(1)  organization  performance  standards,  (2)  present  per- 
formance, and  (3)  clear  definition  of  tasks  required  to 
satisfy  the  organization  performance  standards  (65:53-54). 
Specific  training  needs  are  developed  through  identifica- 
tion of  individuals  or  units  thought  to  be  ineffective 
or  by  establishing  specific  performance  goals  which  are 
used  as  standards  to  evaluate  performance. 
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Warren  viewed  the  difficulty  of  determining  train- 
ing needs  for  middle  managers  and  supervisors  as  caused 
by  a lack  of  congruency  between  the  system  needs  and  top 
management's  expectations  and  said  "...  analysis  will 
bring  together  system  requirements  and  the  various  expec- 
tations to  a point  where  performance  can  be  identified 
[65:189]."  Training  needs  are  developed  through  analysis 
of  a "task  model"  which  identifies  areas  of  substandard 
performance.  These  areas  are  further  analyzed  to  separate 
training  problems  from  problems  symptomatic  of  inefficient 
job  design  (65:194-200).  Elements  of  Warren's  task  model 
are  incorporated  in  the  USAF  ISD  Model  (65:Ch.2). 


The  Mature  Systems  Model 

Robert  Gagne,  one  of  the  early  proponents  of  the 
systems  approach  to  education  and  training,  presented  an 
advanced  version  of  the  approach  in  Principles  of  Instruc- 
tional Design  (20).  Gagne  defined  the  ISD  process  as  an 
interactive,  ongoing  process  using  both  external  and 
internal  feedback.  Gagne's  process  consists  of  twelve 
steps : 

1.  Analysis  and  identification  of  needs, 

2.  Definition  of  goals  and  objectives, 

3.  Identification  of  alternative  ways  to  meet 
needs , 

4.  Design  of  system  components, 

5.  Analysis  of  (a)  resources  required, 

(b)  resources  available,  (c)  constraints, 

6.  Action  to  remove  or  modify  constraints, 

7.  Selection  or  development  of  instructional 
materials , 
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8.  Design  of  student  assessment  procedures, 

9.  Field  testing;  formative  evaluation  and 
teacher  training, 

10.  Adjustments,  revisions,  and  further  evaluation 

11.  Summative  evaluation, 

12.  Operational  installation  [20:212-13]. 

It  is  apparent  that  Gagne's  systems  approach  meets  the 

general  systems  criteria  outlined  earlier  and  his  approach 

is  more  comprehensive  than  other  methods  found  in  the 

review  of  pertinent  literature  (9;  35;  65). 

The  analysis  and  identification  of  needs  drive  the 

design  of  the  instructional  system.  Gagne  stated: 

A major  advantage  of  the  systems  approach  is  that 
it  encourages  the  setting  of  a design  objective,  and 
it  provides  a way  to  know  that  objective  has  been  met 
[20:228] . 

Although  educational  needs  were  stressed,  Gagne  did  not 
address  the  subject  in  specific  detail.  However,  in  a 
previous  study  Gagne  did  include  a more  detailed  discus- 
sion written  by  Robert  B.  Miller  (19:187-228)  which  is 
discussed  in  the  "Task  Description  and  Analysis"  section 
(page  18) . 


Systems  Approach — A Contemporary  Critique 
As  part  of  a comprehensive  review  of  available 
literature  concerning  managerial  effectiveness,  John 
Campbell  made  a detailed  examination  of  the  systems 
approach  to  training  and  educational  needs  determination. 
Campbell  used  the  following  steps  as  a description  of  the 
"traditional"  training  process: 
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1.  Determine  training  needs, 

2.  Choose  a theoretical  approach  (or  approaches) 
appropriate  to  the  types  of  things  that  must  be 
taught, 

3.  Define  the  objectives  of  the  training  effort, 

4.  Develop  a training  program  to  meet  the  train- 
ing objectives, 

5.  Identify  the  individuals  to  be  trained, 

6.  Conduct  the  training, 

7.  Determine  whether  training  has  met  its 
objective  (9:267]. 

Campbell's  description  is  closely  related  to  Gagne's 
and  bears  a generic  resemblance  to  the  Spiral  and 
Warren  models.  Campbell  summarized  the  criticisms  which 
four  other  researchers  (9:267-69)  had  directed  to  train- 
ing systems  models.  First,  training  needs  do  not  exist 
in  a vacuum  and  must  be  examined  in  relation  to  the  organi- 
zation's objectives.  Second,  the  critics  disagreed  with 
the  implication  that  the  training  process  has  a definite 
beginning  and  end.  Campbell's  analysis  of  the  second 
criticism  suggests  that  training  should  be  viewed  as  a 
".  . . continuous  and  self-correcting  process  [9:268]." 
Third,  traditional  training  evaluation  methods  do  not 
provide  a continuous  source  of  feedback  which  could  be 
used  to  adjust  the  training  process.  Finally,  the  tradi- 
tional training  process  is  not  integrated  with  other 
organizational  programs. 

Campbell  found  that  Gagne's  approach  to  training  was 
driven  by  educational  needs  determination,  but 

. . » to  say  that  we  can  analyze  a manager's 
job  into  its  task  components  is  akin  to  saying  that  we 
are  able  to  describe  what  a manager  does  [9:259]. 
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Campbell's  survey  found  that  "...  many  participants  in 
management  development  programs  select  themselves  and  thus 
perform  their  own  needs  analysis  [9:260]."  Although 
Campbell  concluded  that  task  analysis  was  relevant,  a 
critical  incident  technique  would  be  more  effective  in 
training  needs  determination.  Campbell  views  the  critical 
incident  technique  as : 

. . . reports  by  qualified  observers  of  the 
things  people  did  that  were  especially  effective 
or  ineffective  in  accomplishing  parts  of  their 
jobs  [9:77]. 

The  preceding  examination  of  the  various  educa- 
tion system  models  provided  an  essential  background 
for  the  USAF  ISD  Model;  however,  work  relating  to  task 
analysis,  goal  analysis,  and  j-ob  analysis  must  be  reviewed 
for  a full  understanding  of  the  needs  determination  step 
of  the  USAF  ISD  Model. 

Task  Description  and  Analysis 

Miller  stated  "a  task  description  may  best  be 
understood  as  a statement  of  requirements ,"  and  a 

Task  description  specifies  along  a time  scale  the 
cues  which  the  human  should  perceive  in  the  task 
environment  and  the  related  responses  which  the  human 
should  make  in  his  task  environment  [19:197]. 

In  other  words,  tasks  are  lists  of  behaviors  situationally 

defined  for  specific  environments. 

The  specific  behaviors  are  described  by  specifying 
the  "cues"  which  alert  the  human  that  the  task  must  be 

. 


I. 


performed.  Tasks  are  grouped  to  form  activities  described 
by : 

1.  An  indicator  on  which  the  activity-relevant 
indication  appears, 

2.  The  indication  or  cue  which  calls  for  a 
response , 

3.  The  control  object  to  be  activated, 

4.  The  activation  or  manipulation  to  be  made, 

5.  The  indication  of  response  adeauacy  or  feed- 
back [41:201]. 

Miller  defined  an  indicator  as  any  object  or  cue  which 
should  be  perceived  by  the  human  as  a stimulus  for  action 
(41:201).  The  control  object  or  cue  provided  in  a man- 
machine  interface  environment  becomes  obvious  in  a 
specific  situation.  However,  descriptions  of  tasks  become 
complex  when  applied  to  managerial  or  supervisory  posi- 
tions. Adequacy  of  response  to  cues  signals  correct 
behavior  and  is  another  area  which  is  difficult  to  analyze 
in  managerial  situations  (41:203).  In  summary,  task 
descriptions  model  behavioral  responses  in  specific 
work  situations  and  "task  analysis"  is  the  systematic 
study  of  the  behavioral  requirements  inherent  in  the 
task  (task  descriptions).  Miller's  approach  is  similar 
to  procedures  used  in  determining  USAF  technical  train- 
ing needs  (61 :Ch. 2 ,p. 5)  and  represents  a micro-view  of 
educational  needs  determination.  In  contrast,  Mager 
presents  a macro-treatment  of  educational  needs  determina- 
tion in  Goal  Analysis  (36). 
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Goal  Analysis 

Mager  defined  a goal  as  " . . .a  statement 
describing  a broad  or  abstract  intent,  state,  or  condi- 
tion [36:35]."  Mager  introduced  goal  analysis  which 
is  used  to  translate  abstract,  subjective  conditions 
. .to  identify  the  main  performance  that  go  to  make 
up  the  meaning  of  the  goal  [36:10]."  Lynton  and  Pareek's 
critical  incident  technique  and  Miller's  task  description 
procedure  produce  incongruencies  when  applied  to  mana- 
gerial and  supervisory  task  descriptions.  Mager 's  tech- 
nique of  goal  analysis  is  an  approach  which  can  reduce 
these  incongruencies. 

Mager  summarizes  his  goal  analysis  technique  in 
five  steps: 

Step  One:  Write  down  the  goal. 

Step  Two:  Jot  down,  in  words  and  phrases,  the 

performance  that,  if  achieved,  would  cause  you  to 
agree  the  goal  is  achieved. 

Step  Three:  Sort  out  the  jottings.  Delete 

duplications  and  unwanted  items.  Repeat  Steps  One 
and  Two  for  any  remaining  abstractions  (fuzzies) 
considered  important. 

Step  Four:  Write  a complete  statement  for  each 

performance,  describing  the  nature,  quality,  or  amount 
you  will  consider  acceptable. 

Step  Five:  Test  the  statements  with  the  question, 

if  someone  achieved  or  demonstrated  each  of  these  per- 
formances, would  I be  willing  to  say  he  has  achieved 
the  goal  [36:72]? 


Job  Analysis 

Research  in  education  and  training  needs  determin- 
ation, task  analysis,  and  critical  incident  techniques 
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revealed  a relationship  to  research  being  conducted  in 

job  analysis.  Prien  and  Ronan  summarize  current  job 

analysis  research  by  stating: 

In  total,  it  appears  that  job  attribute  require- 
ments can  be  derived  synthetically  and  that  using  the 
worker  oriented  approach  it  would  be  possible  to 
develop  (task)  selection  procedures  directly  based  on 
job  analysis  . . . [47:384]. 

In  spite  of  the  subjective  nature  of  managerial  work,  job 
content  analysis  can  meaningfully  differentiate  between 
jobs  by  specific  identification  of  job  characteristics. 

Task  analysis,  goal  analysis,  and  job  analysis  provide  a 
conceptual  framework  for  the  educational  needs  determina- 
tion of  the  USAF  ISD  Model. 

USAF  Instructional  System  Development  Model 
The  USAF  ISD  Model  can  be  summarized  in  five 
steps  (61 :Ch. 1) : 

1.  Analyze  system  requirements, 

2.  Define  education/training  requirements, 

3.  Develop  objectives  and  tests, 

4.  Plan,  develop  and  validate  instruction,  and 

5.  Conduct  and  evaluate  instruction. 

Specific  provisions  are  made  for  feedback  and  interaction 
at  each  step  of  the  model.  ISD  is  essentially  the  appli- 
cation of  a systems  approach  in  an  educational/training 
environment.  The  designers  of  the  USAF  ISD  Model  recognize 


that : 
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. . . it  is  more  difficult  to  obtain  this  kind  of 
information  [job  task  and  performance  standard]  in 
areas  dealing  mainly  with  the  learning  of  knowledges 
and  attitudes.  However,  the  requirement  still  exists, 
and  a basis  for  designing  and  evaluating  instruction 
still  must  be  identified  [61:Ch.7]. 

The  first  step  of  the  USAF  ISD  Model,  analyze 

system  requirements,  involves  a systems  analysis  designed 


to  identify  system  needs.  Subsequent  steps  of  the  ISD 
Model  determine  instructional  goals  consistent  with  the 
system's  needs  and  identify  behaviors  which  will  reflect 
attainment  of  the  goals  (61:Ch.7).  These  steps  also 
determine  if  a need  for  training  exists  and  results  in  an 
operational  training  system  keyed  to  the  needs  of  the 
users . 

ISD  techniques  have  gained  wide  acceptance  by 
military  technical  training  managers  (1;  7;  61)  and  the 
application  of  ISD  in  a technical  training  environment 
has  been  thoroughly  documented.  For  example,  an  ISD 
key  word  index  and  bibliography  published  in  1974  con- 
tains 2,692  items  (50).  However,  this  literature  review 
failed  to  reveal  documented  application  of  ISD  to  under- 
graduate or  graduate  curricula.  Therefore,  direct  con- 
tact was  established  with  a USAF  Academy  instructor  (53) , 
an  instructor  in  the  Air  University  Academic  Instructor 
Course  (8) , the  Chief  of  Job  Analysis  Branch,  Air  Force 
Human  Research  Laboratory  (39) , a Headquarters  Air  Training 
Command  Training  Specialist  (22) , and  a USAF  Military 
Personnel  Center  Career  Monitor  (24) . Although  the 
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persons  contacted  were  most  interested  in  the  research, 
they  were  unable  to  suggest  additional  sources  of 
information  relevant  to  this  research  effort. 

Undergraduate  and  Graduate  Curricula 

A review  of  the  literature  failed  to  reveal  any 
indication  that  the  systems  approach  has  gained  acceptance 
by  designers  of  undergraduate  and  graduate  business  cur- 
ricula. In  addition,  no  documented  evidence  was  found 
of  attempts  to  apply  a systems  approach  or  a definitive 
educational  needs  analysis  for  curriculum  development. 

Robert  Gordon  implies  that  curriculum  design 
efforts  lack  direction  and 

Despite  their  size  and  entrenched  position, 
the  business  schools  have  not  yet  reached  agreement 
as  to  what  their  objectives  should  properly  be  and 
how  these  objectives  might  best  be  attained  [23:6]. 

Professional  journals  contain  several  reports  of 
accounting  and  financial  management  course  design  efforts 
(12;  14;  15;  48;  51).  These  reports  are  of  very  limited 
use  in  this  research  effort  because  they  do  not  represent 
systematic  education  needs  determination. 

A study  conducted  by  Neeley  and  Robason  to  deter- 
mine the  need  for  a "Government  Accounting"  course  pro- 
vides a helpful  insight  into  course  development  in 
civilian  institutions  (42) . A survey  was  made  of  account- 
ing professors  to  determine  what  is  presently  taught  and 
the  feasibility  of  a governmental  accounting  course.  The 
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response  to  the  survey  reflected  a strong  need  for  the 
course  and  a basis  for  inclusion  in  an  accounting  curricu- 
lum. Limiting  factors  were  lack  of  student  interest  and  an 
already  comprehensive  curriculum  designed  to  satisfy  the 
professional  requirements  of  the  American  Association  of 
Collegiate  Schools  of  Business. 

Although  the  need  for  a close  interface  with  the 
industrial  environment  is  recognized  by  educational  admin- 
istrators (11:101),  the  needs  of  the  users  are  more 
explicitly  defined  for  curriculum  designers  in  a military 
education  environment  (55;  60:61). 

School  of  Systems  and  Logistics 
Curricula  Development 

Curricula  design  efforts  for  graduate  logistics 
programs  in  the  USAF  environment  are  directly  related  to 
the  needs  of  the  users  by  policy  (55:2)  and  curriculum 
reviews  conducted  biennially  (60) . The  Chairman  of  the 
AFIT  School  of  Systems  and  Logistics  Academic  Affairs 
Committee  stated: 

The  purpose  of  these  reviews  is  for  the  users  of 
our  graduates  ...  in  the  major  air  commands  and  in 
Headquarters  USAF  to:  first,  tell  us  what  capabili- 

ties the  graduates  of  this  school  should  have  and, 
secondly,  to  help  us  determine  if  our  curriculum 
provides  this  capability  [6] . 

In  addition  to  external  evaluations  of  the  curriculum, 

both  faculty  development  efforts  and  student  critiques  are 

used  to  modify  the  curriculum  (5) . 


This  chapter  reviewed  education  models,  task 
analysis,  goal  analysis,  and  job  analysis  as  a framework 
for  the  USAF  ISD  Model.  The  US AT  ISD  Model  was  summarized 
ana  the  curriculum  design  effort  of  education  institutions 
and  AFIT  School  of  Systems  and  Logistics  were  reviewed 
to  determine  if  ISD  techniques  had  been  applied.  Since 
no  substantial  evidence  of  ISD  application  was  found,  the 
next  chapter  describes  a plan  for  application  of  the  USAF 
ISD  Model  to  determine  the  financial  management  techniques 
needed  for  GL  coded  positions. 


CHAPTER  III 


METHODOLOGY 

This  chapter  describes  the  methodology  used  to 
answer  the  research  questions,  the  population,  the 
sampling  plan,  the  data  collection  plan,  and  a summary 
of  assumptions  and  limitations. 

First  Research  Question 

The  design  to  answer  the  first  research  question, 
"Can  goal  analysis  be  used  to  identify  financial  manage- 
ment techniques  required  for  GL  positions?"  consists  of  a 
series  of  four  steps.  As  a first  step,  the  researchers 
arbitrarily  established  four  categories  of  financial 
management  techniques: 

1.  Capital  budgeting — ".  . . the  entire  process 
of  planning  expenditures  whose  returns  are  expected  to 
extend  beyond  one  year  [66:136]." 

2.  Financial  forecasting — the  determination  of 
capital  assets  required  to  support  the  organization's 
activities  (66:81). 

3.  Working  capital--the  management  of  USAF  stock 
and  industrial  funds. 

4.  Cost  accounting — the  system  for  collecting  and 
analyzing  cost  data  (2:304). 
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The  categories  facilitated  identification  of  financial 
management  techniques  and  development  of  corresponding 
behavioral  descriptions. 

The  second  step  consisted  of  listing  financial 
management  techniques  used  in  GL  positions.  The  third 
step  involved  the  application  of  goal  analysis  to  develop 
a behavioral  description  which  will  signal  the  use  of  a 
specific  financial  management  technique.  For  example, 
determining  the  payback  period  of  a proposed  investment 
is  a common  capital  budgeting  technique  (66:144).  Use  of 
the  payback  period  technique  would  be  signaled  if  a 
person  calculated  the  initial  investment  required,  calcu- 
lated the  net  annual  cash  flow  expected  from  the  invest- 
ment, and  finally  divided  the  initial  investment  by  the 
net  annual  cash  flow.  The  fourth  step  was  to  consult  with 
logistics  experts  assigned  to  the  graduate  faculty  of  the 
AFIT  School  of  Systems  and  Logistics6  to  refine  and 
modify  the  list  of  financial  management  techniques  and 
behavioral  descriptions. 

The  criteria  for  the  first  research  question  is 
that  experts  were  able  to  identify  financial  management 
techniques  appropriate  to  their  functional  area.  The 

6Hereafter  referred  to  as  experts.  It  is  assumed 
that  the  judgment  of  the  experts  can  be  extended  to  all 
GL  positions  within  the  expert's  specialty.  However,  it 
was  not  assumed  that  the  experts  were  aware  of  all  finan- 
cial management  techniques  which  could  be  applied  in  their 
specialty. 


28 


judgment  of  the  experts  could  support  the  contention  that 
financial  management  techniques  and  appropriate  behavioral 
descriptions  could  be  written  for  GL  coded  positions. 
Additional  support  could  be  found  in  the  pilot  study  of  a 
survey  instrument  and  in  the  analysis  of  survey  data  used 
in  answering  the  second  research  question. 

Second  Research  Question 

The  design  to  answer  the  second  research  question, 
".  . . what  financial  management  techniques  are  required 

for  GL  positions?"  required  an  affirmative  answer  for  the 
first  research  question.  The  second  research  question  was 
answered  by  identifying  and  describing  the  financial  man- 
agement techniques  required  for  GL  positions. 

Population 

The  universe  relevant  to  this  study  included  all 
USAF  officer  positions.  For  the  purpose  of  this  study, 
logistics  officer  positions  were  defined  by  the  USAF 
Specialty  Codes  (AFSCs)  listed  in  Table  1.  The  positions 
listed  in  Table  1 having  been  assigned  an  Advanced  Academic 
Degree  (AAD)  code  of  1AMY , 1AMH,  1AGA,  or  1AYY  in  accordance 
with  USAF  Manual  36-19,  Advanced  Academia  Degree  Manage- 
ment System  (54)  comprised  the  population  of  interest  for 
this  study.  It  was  assumed  that  GL  positions  were  properly 
validated  and  reflect  actual  requirements.7 

7Two  studies  (4;  31)  described  the  AAD  validation 
process  in  detail  and  identified  inconsistencies  in  the 
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TABLE  1 

GRADUATE  LOGISTICS  POSITIONS 


AFSC 

Utilization  Field 

AAD 

Code 

0046 

Director  of  Logistics* 

lAMY 

30  XX 

Communication  Electronics* 

1AMY 

31XX 

Missile  Maintenance 

lAMY 

4 OXX 

Aircraft  Maintenance /Avionics 

lAMY 

4 6 XX 

Munitions 

lAMY 

55XX 

Civil  Engineering* 

1AGA 

6 OXX 

Transportation 

lAMY 

62XX 

Supply  Services 

1AYY 

6 3XX 

Fuels  Management 

1AYY 

64XX 

Supply  Management 

1AYY 

6 5XX 

Procurement  Management 

1AMH 

6 6 XX 

Logistics  Plans  and  Programs 

lAMY 

SOURCE:  AFM  36-1,  Officer  Classification  Manual, 

28  May  1969,  and  AFM  36-19,  Advanced  Academic  Degree  Man- 
agement System  (AADMS),  15  November  1973. 

NOTE:  AAD  codes  lAMY,  1AMH,  and  1AGA  correspond 

to  the  AFIT  School  of  Systems  and  Logistics  Logistics 
Management,  Logistics  Management  with  a Procurement  Major, 
and  Facilities  Management  degree  programs.  Graduates  of 
the  Logistics  Management  Program  are  also  assigned  to 
positions  with  logistics  AFSCs  carrying  an  AAD  code  of  1AYY. 

*Not  included  in  AFM  36-1  definition  of  logistics 
career  area. 
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After  the  population  was  identified,  a choice 
between  a census  or  sample  had  to  be  made.  A census  of 
the  population  would  have  had  the  primary  advantage  of 
certainty  that  each  member  of  the  population  had  been 
contacted,  thus  eliminating  sampling  errors  (29:337). 
According  to  Helmstadter,  the  resources  (time,  manhours, 
and  money)  are  a significant  factor  when  considering 
the  feasibility  of  a census  (29:336).  A census  was 
rejected  because  the  resources  required  greatly  exceeded 
the  resources  available  for  this  study. 

Sampling  Plan 

Since  a census  was  not  feasible  for  this  research,  a 
sampling  method  was  selected  as  a less  expensive  way  of 
collecting  comprehensive  data  within  a limited  time  frame 
(68:6).  This  probabilistic  sampling  technique,  based 
upon  random  selection,  has  the  advantage  of  controlling 
precision  and  accuracy,  as  well  as  limiting  the  bias  of 
the  sample.  Most  importantly,  a random  sample  enables 
inferences  from  the  sample  to  the  population  (29:338). 

A random  stratified  sampling  technique  was 
selected  because  stratified  samples  are  more  precise  than 
simple  random  samples  and  do  not  require  additional 
resources  (29:339).  Since  the  purpose  of  the  USAF 
Officer  Classification  System  was  to  create  homogeneous 
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groups  (62) , AFSCs  were  selected  as  a basis  for  stratifi- 
cation. Sufficient  knowledge  about  the  homogeneity  of 
other  bases  for  stratification,  such  as  rank  or  level  of 
assignment  did  not  exist.  Stratification  was  further 
improved  by  proportional  sampling. 

Stratified  Proportional  Sampling.  Stratified 
proportional  sampling  has  the  advantage  of  further  increas- 
ing the  precision  of  a sample.  This  technique  insures 
proper  representativeness  of  the  attributes  which  the 
researcher  considers  important.  Even  if  the  stratifica- 
tion is  based  upon  nonhomogeneous  characteristics,  Parten 
states  the  sample  will  be  no  worse  than  a simple  random 
sample  (44:228) . 

Table  2 reflects  the  results  of  proportionally 
allocating  sample  elements  within  strata.  The  sample 
elements  for  each  strata  ( N ^)  were  found  by  the  following 
equation  (68:153): 

N. 

_ 1 _ 


where : 

N . is  the  number  of  elements  in  the  stratum 

t 

(authorizations  in  each  AFSC) , 

N is  the  total  authorizations,  and 
n is  the  desired  sample  size. 
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TABLE  2 


GRADUATE  LOGISTICS 

POSITION  SAMPLE 

STRATA 

AFSC 

Authorized 

Assigned 

Invited  Sample 

0046 

161 

116 

35 

30XX 

96 

67 

21 

31XX 

58 

51 

13 

40  XX 

119 

83 

26 

46XX* 

0 

0 

0 

55XX* 

0 

0 

0 

60XX 

26 

24 

6 

62XX* 

0 

0 

0 

63XX* 

0 

0 

0 

6 4 XX 

46 

30 

10 

65XX 

67 

43 

14 

66XX 

134 

84 

29 

Total 

707 

498 

154 

SOURCE:  Data  were  supplied  by  AFIT  Consolidated 

Base  Personnel  Office  from  USAF  Military  Personnel  Center 
Manpower  authorizations  as  of  30  April  1976. 

*No  relevant  authorizations  were  found.  A recent 
realignment  of  AFSCs  and  other  factors  outside  the  scope 
of  this  study  altered  the  authorization  structure. 
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Sample  Size.  Yamane  and  Hansen  et  al.,  both 
provide  procedures  for  determining  the  sample  size  requir- 
ing estimates  of  the  underlying  population  variance  and 
the  population  proportion  for  each  variable  (68:154-55; 
28:213-15).  However,  the  information  required  for  popu- 
lation estimates  was  unavailable. 

Mildred  Parten  stated  "a  review  of  the  literature 
in  the  survey  field  reveals  . . . much  contradictory 

and  misleading  advice  regarding  sample  size  [44:290]." 

For  example,  using  Parten 's  procedure  (44:314),  a sample 
size  of  sixty-nine  elements  would  be  required  to  capture 
the  financial  management  techniques  used  by  90  percent 
of  the  population  with  a ±5  percent  error  range  in  90 
out  of  100  samples.  The  sample  size  computed  using  another 
technique  was  sixty  one  (56:118).  Since  a definitive 
method  to  compute  sample  size  could  not  be  found,  a 
desired  sample  size  of  100  elements  was  arbitrarily 
selected  as  a liberal  sample  size;  however,  a sample  size 
of  at  least  65  would  be  considered  sufficient  for  this 
research  project. 

Data  Collection  Plan 

USAF  Manual  50-2,  Instructional  System  Development , 

suggested  five  means  of  collecting  data:  occupational 

survey,  checklist,  interview,  observation,  and  question- 
naire (61 :Ch. 2 ,pp. 5-6) . One  occupational  survey,  30XX 
AFSC , was  found  (63) . The  results  of  the  survey  will  be 
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reported  and  analyzed  along  with  the  other  data  produced 
by  this  research  effort.  Checklists,  interviews,  and 
observations  were  considered,  but  the  resources  (time, 
manhours,  and  money)  necessary  for  data  collection  were 
unavailable  for  this  research.  The  mail  questionnaire 
technique  was  selected  because  it  made  the  least  demand 
on  the  limited  available  resources.  The  advantages  of 
the  mail  questionnaire  are  (44  :94): 

1.  A wide  geographical  area  can  be  covered. 

2.  A larger  proportion  of  the  population  can  be 
reached  using  a questionnaire  than  by  personal  interviews 
with  a given  amount  of  funds. 

3.  Mailing  costs  are  lower  than  transportation 
and  time  costs  of  a field  staff. 

4.  The  expense  and  time  required  to  train  a 
field  staff  are  eliminated. 

Studies  of  similar  populations  encountered  survey 
response  rates  of  approximately  65  percent  (31:28,36; 
38:24).  Based  upon  these  studies,  an  initial  survey 
response  rate  of  65  percent  was  expected;  therefore,  an 
invited  sample  size  of  154  was  necessary  to  achieve  the 
desired  100  returns. 

Using  the  data  in  Table  2 and  the  equation  on 
page  31,  the  sample  size  for  each  stratum  was  calculated 
and  is  shown  in  the  invited  sample  column  of  Table  2. 
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Development  of  a Survey  Instrument.  A survey 
instrument  was  developed  using  financial  management  tech- 
niques and  behavioral  descriptions  identified  in  the  answer 
to  the  first  research  question. 

The  survey  questions  are  behavioral  descriptions 
of  financial  management  techniques.  The  subject  was 
asked  to  indicate  what  proportion  of  his  job  the  behavior 
represents  and  to  indicate  the  perceived  importance  of 
the  behavior. 

A scale  developed  by  the  USAF  Occupational  Research 
Center  and  used  by  Meri-Akri  and  Walton  (40:38)  was  modified 
for  this  study.  Table  3 depicts  this  scale. 

TABLE  3 

JOB  PROPORTION  SCALE 


Value 

Proportion 

0 

Not  part  of  my  present  job 

1 

An  extremely  small  part  of  my 

job 

2 

A very  small  part  of  my  job 

3 

A small  part  of  my  job 

4 

A moderate  part  of  my  job 

5 

A large  part  of  my  job 

6 

A very  large  part  of  my  job 

7 

An  extremely  large  part  of  my 

job 

The  importance  that  the  subjects  associate  with 
the  behaviors  identified  in  the  survey  questions  was 
measured  using  a modification  of  a scale  suggested  by 
Parten  (44:192).  This  scale  is  shown  in  Table  4. 


TABLE  4 

IMPORTANCE  SCALE 


Value 

Importance 

0 

Not  part  of  my  present 

job 

1 

Very  low  importance 

2 

A little  below  average 

importance 

3 

Average  importance 

4 

A little  above  average 

importance 

5 

Very  high  importance 

Both  scales  meet  Siegel 1 s (52  :23-24)  and  Helmstadter ' s 
(20:178-79)  requirements  for  ordinal  level  data. 

The  demographic  section  of  the  survey  instrument 
requested  the  following  information: 

Name  (optional) 

Rank 

Duty  Title 
DAFSC 

Level  of  Assignment 
Organization 
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Base 
M AJCOM 

Months  in  Present  Position 
Position  Number 

Parts  of  the  demographic  data  were  used  to  confirm  that  the 
survey  was  completed  by  the  intended  subject  and  the 
remainder  of  the  demographic  data  was  used  to  further 
differentiate  the  data  for  analysis. 

Validation  of  Survey  Instrument.  The  questionnaire 
was  first  validated  by  the  same  experts  who  were  consulted 
during  the  development  of  behavioral  descriptions.  To 
further  test  the  validity  of  the  survey  instrument,  the 
questionnaire  was  administered  as  part  of  a personal  inter- 
view with  six  randomly  selected  officers  occupying  GL 
coded  positions  located  on  Wright-Patterson  Air  Force 
Base,  Ohio  (24).  The  questionnaire  was  scored  and  the 
respondent's  reactions  to  the  questions  were  noted  and 
used  to  modify  misleading  questions.  The  subjects  used 
in  the  pilot  study  were  excluded  from  the  survey.  At 
that  point,  it  was  assumed  the  questionnaire  was  valid  and 
could  be  used  to  determine  the  financial  management  tech- 
niques used  in  GL  coded  positions. 


Administration  of  Survey  Instrument.  After  the 
validated  questionnaire  was  submitted  through  normal 


channels  for  approval  (58) , subjects  were  sequentially 
selected — for  example  (using  Table  2 data  for  66XX  AFSC) : 
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1.  Each  of  the  134  authorized  AFSC  66XX  positions 
were  subsequently  numbered. 

2.  Twenty-nine  numbers  were  selected  from  a 
table  of  random  numbers. 

3.  Position  numbers  corresponding  to  the  random 
numbers  were  used  in  the  survey. 

4.  A mailing  list  was  developed  for  the  ran- 
domly selected  positions. 

The  subjects  were  asked  to  return  the  completed 
questionnaire  within  one  week  of  receipt.  At  the  end 
of  three  weeks,  a follow-up  questionnaire  was  mailed  to 
nonrespondents . 

Scoring  of  Survey  Instrument.  Valid  questionnaire 
responses  were  identified  by  several  data  items: 

1.  The  credibility  of  the  respondent  was  sup- 
ported by  requiring  at  least  three  months  experience  in 
the  position. 

2.  The  DAFSC  corresponded  to  that  of  the  desired 
position . 

3.  The  respondent  was  assigned  to  a desired 
(GL)  position. 

4.  The  demographic  data  did  not  contain  fallacious 


combinations  of  information  (e.g.,  DAFSC  4021  with  a 
wing  commander's  duty  title). 
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Criteria  for  Research  Question  Two.  The  criteria 
for  the  answer  to  the  second  research  question,  "...  what 
financial  management  techniques  are  required  for  GL  posi- 
tions?" were  found  in  several  areas: 

1.  Goal  analysis  was  successfully  used  to  write 
behavioral  descriptions  of  financial  management  tech- 
niques . 

2.  A valid  survey  instrument  could  be  developed 
to  indicate  the  use  of  financial  management  techniques  in 
GL  positions. 

3.  A random  survey  was  conducted  and  analysis 
of  the  subjects'  responses  indicated  that  some  of  the 
techniques  were  used  in  GL  positions. 

Summary  of  Assumptions  and  Limitations 

The  assumptions  made  for  this  study  are  summarized 
as  follows: 

1.  GL  positions  have  been  properly  validated 
and  reflect  actual  requirements  by  the  procedure  found  in 
AFM  36-19  (54) . 

2.  The  judgment  of  the  graduate  faculty  of  the 
AFIT  School  of  Systems  and  Logistics  can  be  used  to 
identify  financial  management  techniques  required  in 

GL  coded  positions. 

3.  The  USAF  Officer  Classification  System  groups 
officers  into  homogeneous  groups  defined  by  AFSC. 
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4.  The  procedures  used  to  validate  the  question- 
naire resulted  in  a valid  survey  instrument. 

5.  The  GL  coded  positions  constitute  the  primary 
need  for  graduates  of  the  AFIT  Graduate  Management  Program. 

6.  The  pilot  study  produced  a valid  survey  instru- 
ment to  use  in  testing  the  questionnaire  technique. 

The  limitations  of  this  study  are  as  follows: 

1.  The  survey  instrument  was  designed  for  GL 
financial  management  techniques  and  should  not  be  used 
for  other  applications. 

2.  This  study  was  limited  to  USAF  officer  GL 
positions  and  should  not  be  generalized  to  USAF  civilian 
and  other  DOD  positions. 

3.  The  results  of  this  research  are  limited  to 
the  AFIT  School  of  Systems  and  Logistics,  Graduate 
Management  curriculum. 
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CHAPTER  IV 


ANALYSIS 


The  analysis  contained  in  this  chapter  provides 
the  background  required  to  answer  the  questions  which 
guided  this  research  effort. 


Research  Question  One 

The  design  to  answer  the  first  research  question, 
"Can  goal  analysis  be  used  to  identify  financial  manage- 
ment techniques  required  for  GL  positions?"  involved 
three  steps:  (1)  developing  categories  which  could  be 

associated  with  financial  management  techniques,  (2) 
identifying  techniques  which  could  be  used  in  GL  posi- 
tions and  developing  behavioral  descriptions  to  signal 
usage  of  specific  techniques,  and  (3)  consulting  experts 
to  refine  and  modify  the  list  of  financial  management 
techniques  used  in  GL  positions. 

Developing  Categories 

The  primary  advantage  of  grouping  financial 
management  techniques  was  that  grouping  enabled  the  appli- 
cation of  goal  analysis.  Goal  analysis  was  used  to  trans- 
late the  financial  management  categories  into  performance 
characteristics.  The  categories  represent  goals,  and 
techniques  represent  specific  performance  characteristics. 

41 


42 


For  example,  cost  accounting  represents  a goal  achieved 
through  use  of  a specific  technique  (performance  charac- 
teristic)— analysis  of  variance. 

Identifying  Techniques 

The  initial  arbitrary  grouping  of  financial  man- 
agement techniques  (Appendix  C)  served  as  a starting  point 
which  guided  a search  for  prospective  techniques  required 
for  GL  positions.  Grouping  also  provided  a common  frame- 
work and  a starting  point  for  discussion  of  techniques 
with  logistics  experts  (see  footnote  on  page  27).  At 
the  beginning  of  the  interview  with  each  expert,  the 
categories  were  identified  and  described  to  guide  discus- 
sion of  prospective  financial  management  techniques. 
Interviews  with  logistics  experts  revealed  that  a major 
category  applicable  to  military  logistics  positions, 
programming,1  had  been  omitted.  Once  the  programming 
category  was  included,  several  prospective  techniques 
were  added. 

After  the  financial  management  techniques  had  been 

identified,  a method  of  identifying  the  use  of  specific 

techniques  had  to  be  developed.  Miller's  approach  to 

task  analysis  specifies  that  people  receive  "cues"  from 

the  environment  which  signal  that  a task  must  be 
— 

‘Programming  is  defined  as  scheduling  resources 
to  support  USAF  operations. 
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performed  (41:201).  This  approach  was  modified  by  develop- 
ing behavioral  descriptions  which  would  signal  the  use  of 
specific  financial  management  techniques.  For  example, 
a person  identifying  and  analyzing  the  differences 
between  planned  and  actual  expenditures  would  signal  use 
of  a cost  accounting  technique--analysis  of  variance. 

Consulting  Experts 

The  potential  techniques  and  behavioral  descrip- 
tions (Appendix  C)  were  reviewed  during  interviews  with 
logistics  experts.  The  interviews  allowed  the  experts 
to  confirm  techniques  used  in  their  functional  area  and 
were  a valuable  source  of  additional  techniques.  The 
experts  were  aware  of  techniques  which  had  been  adapted 
for  their  functional  area  and  were  also  familiar  with 
the  behaviors  exhibited  by  people  using  the  techniques. 

In  addition,  the  experts  knew  of  techniques  and  were 
able  to  describe  the  behaviors  exhibited  by  people  in  GL 
positions.  Therefore,  the  interviews  prevented  the 
researchers'  experience  from  becoming  a limiting  factor 
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some  GL  positions.  The  experts  also  verified  that  the 
behavioral  descriptions  could  be  used  to  indicate  use  of 
the  financial  management  techniques.  The  confirmation  by 
the  experts  was  sufficient  evidence  to  conclude  that 
goal  analysis  could  be  used  to  identify  the  financial 
management  techniques  required  in  GL  positions.  Additional 
support  for  this  conclusion  will  be  discussed  in  the  anal- 
ysis of  the  second  research  question. 

Research  Question  Two 

Analysis  of  the  answer  to  research  question  two, 

"If  goal  analysis  can  be  used  to  identify  financial  man- 
agement techniques,  what  financial  management  techniques 
are  required  for  GL  positions?"  involved  analysis  of  an 
occupational  survey  conducted  by  the  USAF  Occupational 
Measurement  Center  (63)  and  an  evaluation  of  this  proj- 
ect's survey  instrument,  pilot  study,  sample  size, 
follow-up  survey  administration,  and  survey  results. 

Occupational  Survey  Analysis 

USAF  ISD  guidance  contained  in  AFK  50-2  (61) 
suggests  that  occupational  surveys  be  used  to  collect 
data  for  the  educational  needs  determination  step  of 
the  USAF  ISD  Model.  However,  only  one  occupational  sur- 
vey, for  the  30XX  utilization  area,  has  been  completed 
and  documented  for  USAF  officer  positions  (63) . This 
occupational  survey  was  a census  of  the  entire  30XX  AFSC 
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officer  population  and  indicated  that  7 percent  of  the 
respondents  "prepare  economic  analyses"  (63:78).  The 
report  contained  insufficient  evidence  that  30XX  person- 
nel use  financial  management  techniques.  In  addition  to 
lacking  sufficient  detail  about  the  use  of  financial 
management  techniques , the  report  requested  responses 
from  the  entire  30XX  population.  Even  if  sufficient  detail 
had  existed,  the  occupational  survey  could  not  have  been 
used  because  only  the  needs  of  GL  positions  are  relevant 
to  this  study. 

Analysis  of  the 
Survey  Instrument 

The  answer  to  the  first  research  question  was 
affirmative  and  enabled  questions  to  be  written  based 
upon  the  behavioral  descriptions . Once  the  questions 
were  written,  the  same  logistics  experts  consulted  in 
answering  the  first  research  question  were  again  con- 
sulted to  review  the  questions.  The  questions  were  con- 
sistent with  the  experts'  terminology  and  the  logistics 
experts  supported  the  assertion  that  the  questions 
reflected  the  behavioral  descriptions  associated  with  the 
financial  management  techniques.  Additionally,  the  experts 
suggested  the  addition  of  an  open-ended  question  to  capture 

| 

financial  management  techniques  not  addressed  in  the 
questionnaire.  The  respondents  were  therefore  asked  to  add 

. 

related  tasks  which  they  thought  were  omitted  from  the 
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questionnaire.  Responses  to  the  open-ended  questions 
were  related  to  specific  tasks  within  functional  areas 
and  were  within  the  scope  of  existing  questions. 

The  job  proportion  scale  with  eight  categories 
was  used  in  the  questionnaire  because  the  researchers 
hypothesized  that  financial  management  tasks  would  not 
comprise  a large  proportion  of  the  tasks  required  in 
GL  positions.  Analysis  of  the  responses  confirms  that 
most  respondents  do  not  spend  a large  proportion  of  their 
time  using  financial  management  techniques  (Appendix  F) . 

The  respondents  who  indicated  any  use  of  a technique 
ranged  from  9.8  percent  for  ratio  analysis  to  69  percent 
for  cost  accounting.  The  most  widely  used  technique 
(cost  accounting)  constituted  a large,  very  large,  or 
extremely  large  proportion  of  the  job  for  only  15  percent 
of  the  respondents. 

The  job  importance  scale  was  included  to  allow 
the  respondents  to  indicate  the  importance  which  they 
associated  with  the  financial  management  tasks.  Since 
most  GL  positions  do  not  require  extensive  use  of  finan- 
cial management  techniques,  the  importance  of  seldom 
used  techniques  could  be  of  value  for  an  educator  asses- 
sing the  techniques  used  in  GL  positions.  For  example, 
both  seldom  used  but  important  techniques  and  often  used 
but  unimportant  techniques  could  be  useful  information  to 
the  educator  during  curriculum  development. 
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Pilot  Study 

The  pilot  study  interviews  provided  immediate 
feedback  on  the  questionnaire  construction  and  content. 
Although  the  respondents  were  not  allowed  to  ask  clarify- 
ing questions  while  completing  the  questionnaire,  an 
immediate  debriefing  session  revealed  that  the  respon- 
dents did  not  encounter  confusing  instructions,  mis- 
leading questions,  or  unfamiliar  terminology.  These  inter- 
views supported  the  technique  of  writing  questions  from 
behavioral  descriptions  and  using  those  questions  to 
indicate  the  actual  use  of  specific  financial  management 
techniques.  The  pilot  study  interviews  also  indicated 
that  questions  could  be  worded  in  general  terms  and 
produce  meaningful  responses  from  personnel  in  several 
different  utilization  areas.  Because  of  the  question- 
naire's applicability  to  all  logistics  utilization  areas, 
a separate  questionnaire  was  not  needed  for  each  AFSC. 

Sample  Size 

The  sample  size  was  affected  by  the  response  and 
scoring  rates.  The  anticipated  response  rate  of  65  per- 
cent was  not  achieved  with  the  original  survey;  only 
50  percent  of  the  original  survey  responses  were  received 
by  the  end  of  the  sixth  week.  Three  weeks  after  the  mail- 
ing of  the  original  survey,  an  identical  follow-up  survey 
was  mailed  to  all  nonrespondents.  The  follow-up  response 
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rate  reached  46  percent  when  data  collection  was  cut  off 
at  the  end  of  three  weeks.  After  the  original  and 
follow-up  responses  had  been  combined,  an  overall  response 
rate  of  77  percent  was  achieved  (Appendix  A) . 

The  criteria  used  to  identify  valid  responses 
resulted  in  the  scoring  of  86  percent  of  the  original 
responses  and  76  percent  of  the  follow-up  responses. 

The  primary  reasons  for  not  scoring  the  original  responses 
were  either  that  the  respondent  was  not  in  a GL  position 
or  the  researchers  could  not  verify  that  the  response  came 
from  a person  in  a GL  position.  The  primary  reason  for 
not  scoring  the  follow-up  responses  was  that  the  respon- 
dent indicated  that  he  had  previously  completed  the  survey 
and  did  not  complete  the  follow-up  survey.  The  overall 
scoring  rate  shown  in  Appendix  A is  82  percent  for 
97  scored  responses.  Although  the  desired  conservative 
sample  size  of  100  was  not  achieved,  the  97  scored 
responses  exceeded  the  minimum  desired  sample  size  of 
65.  The  researchers  concluded  that  the  response  and 
scoring  rates  resulted  in  an  acceptable  sample  size. 

Follow-Up  Survey 
Administration 

Three  weeks  after  the  original  questionnaires 
were  mailed,  an  initial  analysis  of  the  responses  indi- 
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positions.  The  remaining  nonrespondents  were  distributed 
among  other  major  commands. 

The  researchers  contacted  HQ  USAF  administrative 
personnel  to  determine  whether  the  addressing  procedures 
used  in  the  original  mailing  had  been  adequate.  The 
administrative  personnel  indicated  that  an  address  with 
duty  title,  organization,  and  base  did  not  adequately 
identify  the  intended  addressee  at  HQ  USAF.  However, 
it  appeared  that  this  addressing  procedure  was  sufficient 
for  most  positions  below  the  HQ  USAF  level.  To  improve 
the  addressing  procedure  for  the  follow-up,  the  researchers, 
where  possible,  added  the  intended  respondent ' s name  and 
office  symbol  to  the  address.  Although  names  were  avail- 
able, office  symbols  had  to  be  identified  on  a case-by- 
case  basis  by  consulting  a HQ  USAF  telephone  directory. 

The  characteristics  of  the  original  and  follow-up 
respondents  are  shown  in  Appendix  E.  Comparison  of  the 
HQ  USAF  responses  indicate  that  the  HQ  USAF  addressing 
problem  was  solved.  While  the  original  survey  did  not 
contain  any  responses  from  the  60XX  AFSC,  the  follow-up 
obtained  four  valid  responses,  and  the  HQ  USAF  response 
increased  from  9 to  32  percent.  Comments  on  five  of  the 
ten  scored  follow-up  responses  from  HQ  USAF  positions  indi- 
cated that  the  had  not  received  the  original  survey. 

The  researchers  had  anticipated  that  the  use  of  names 
could  prevent  the  survey  from  reaching  the  desired 


f 


l 


r 


50 

position  if  a recent  personnel  change  had  occurred; 
however,  the  use  of  names  in  the  follow-up  significantly 
increased  the  response  rate  from  HQ  USAF  positions  with- 
out decreasing  the  scoring  rate. 

Survey  Results 

The  survey  results  confirm  the  judgement  of  the 
logistics  experts  in  identifying  financial  management 
techniques  required  in  GL  positions.  The  results  of 
the  Binomial  Test  (Appendix  B)  show  the  statistically 
significant  questions  and  categories  for  each  AFSC.  The 
statistical  significance  of  the  questions  is  just  one 
element,  to  be  considered  by  the  educator  during  cur- 
riculum development  and  review.  Another  element  to  be 
considered  is  the  importance  associated  with  financial 
management  techniques  by  the  respondents.  A cross- 
tabulation of  the  proportion  responses  by  importance 
responses  for  each  survey  question  is  contained  in 
Appendix  G.  The  rows  represent  the  relative  job  propor- 
tion which  the  task  represents  for  the  respondent's  job, 
while  the  columns  show  the  relative  importance  the 
respondents  associated  with  the  task.  For  a detailed 
explanation  of  the  scoring  categories  for  both  the  job 
proportion  and  job  importance  scales,  refer  to  pages  35,  36 

or  Appendix  D. 

I 

In  summary,  the  analysis  of  research  question 
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two  has  revealed  that  behavioral  descriptions  can  be  used 


to  develop  questions  which  signal  the  use  of  financial 
management  techniques. 

Interviews  with  logistics  experts,  a pilot  study, 
and  the  analysis  of  the  survey  responses  indicated  that 
the  financial  management  techniques  required  in  GL  posi- 
tions could  be  identified  using  this  research  methodology 
The  judgment  of  the  experts  which  indicated  that  certain 
techniques  were  used  in  GL  positions  has  been  supported 
by  the  pilot  study  and  the  survey  results, thereby  pro- 
viding additional  support  for  the  answer  to  the  first 
research  question.  The  researchers  conclude  that  the 
financial  management  techniques  required  for  GL  positions 
have  been  identified  and  fall  in  the  following  categories 
capital  budgeting,  cost  accounting,  working  capital, 
financial  forecasting,  and  programming.  The  techniques 
are  listed  by  category  in  Appendix  F and  constitute  a 
successful  answer  for  the  second  research  question. 


CHAPTER  V 


SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 

The  purpose  of  this  research  effort  was  to  con- 
form with  USAF  ISD  policy  by  applying  the  first  step 
of  the  ISD  Model  to  determine  the  financial  management 
needs  of  GL  positions.  The  effort  was  guided  by  two 
research  questions:  "...  can  goal  analysis  be  used 

to  identify  financial  management  techniques  required 
for  GL  positions  . . . [and]  . . . what  financial  manage- 
ment techniques  are  required  for  GL  positions  ..." 

Summary  and  Conclusions 

The  analysis  of  the  results  of  this  research 
effort  indicates  that  goal  analysis  can  be  used  to  iden- 
tify the  financial  management  techniques  required  for 
GL  positions.  Support  for  this  conclusion  was  found  in 
the  researchers'  ability  to  categorize  and  identify  tech- 
niques which  were  thought  to  be  used  in  GL  positions  and 
to  confirm  the  use  of  the  techniques  by  administering  a 
survey. 

The  researchers  identified  five  categories  into 

which  financial  management  techniques  could  be  placed: 

capital  budgeting,  financial  forecasting,  working 

capital,  cost  accounting,  and  programming.  Goal  analysis 

was  then  used  to  develop  a list  of  techniques  which  could 
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be  used  in  GL  positions.  A modified  approach  to  task 
analysis  was  used  to  develop  behavioral  descriptions  which 
would  indicate  the  use  of  the  techniques  by  people  in  GL 
positions.  Logistics  experts  confirmed  that  the  tech- 
niques were  used  in  their  functional  area  and  that  the 
behavioral  descriptions  could  indicate  use  of  the  tech- 
niques. The  survey  data  supports  the  judgment  of  the 
logistics  experts  and  indicates  that  the  financial  manage- 
ment techniques  identified  using  goal  analysis  are  used 
in  GL  positions.  The  researchers  conclude  that  the  use 
of  financial  management  techniques  in  GL  positions  can 
be  identified  through  use  of  goal  analysis.  Therefore, 
the  first  research  question  has  been  successfully  answered. 

Once  the  financial  management  techniques  required 
in  GL  positions  had  been  identified  using  goal  analysis, 
a questionnaire  was  written.  Face  validity  of  the  ques- 
tionnaire was  supported  by  consulting  logistics  experts 
and  conducting  a pilot  study.  This  approach  confirmed 
that  behavioral  descriptions  could  be  used  to  write 
questions  which  would  reflect  the  use  of  financial  manage- 
ment techniques. 

Analysis  of  the  sample  size  indicates  that  a 
random  stratified  proportional  sampling  plan  was  suc- 
cessfully used  to  collect  data  from  a population  of 
707  GL  positions.  The  use  of  statistically  sound  sampling 
procedures  enabled  the  researchers  to  conclude  that  the 


techniques  identified  in  capital  budgeting,  working 
capital,  cost  accounting,  financial  forecasting,  and 
programming  categories  are  chacteristic  of  all  CL  posi- 
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tions.  Identification  of  the  techniques  constitutes  a 
successful  answer  for  the  second  research  question. 

Recommendations 

The  researchers  believe  that  the  methodology 
used  in  this  research  project  could  be  successfully  applied 
to  other  graduate,  undergraduate,  and  professional 
military  curriculum  design  efforts.  Initially,  it  may 
seem  that  structured,  task-oriented  subject  matter  is 
required,  but  goal  analysis  and  task  analysis  are  poten- 
tially useful  in  nontask  structured  areas  such  as  manage- 
ment and  military  science.  For  example,  communications  can 
be  approached  by  breaking  the  area  down  into  its  compo- 
nent parts:  written  communication,  oral  communication, 

nonverbal  communication,  and  so  forth.  Effective  written 
communications  can  be  considered  a goal  achieved  by 
several  techniques:  analysis  of  the  communications 

subject;  selecting  an  approach  or  writing  style  based 
upon  the  intended  audience;  research , note  taking , and 
outlining  techniques;  and  the  application  of  grammatical 
rules.  Task  analysis  could  then  be  used  to  write  behav- 
ioral descriptions  which  would  signal  the  use  of  these 
techniques.  The  educational  needs  determination  step  of 
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the  ISD  Model  could  be  accomplished  using  an  appropriate 
data  collection  technique. 

The  researchers  think  that  the  requirement  for 
a specific  target  population  varies  with  the  educational 
curriculum  design  effort.  This  research  project  was 
concerned  with  a specific,  well-defined  population  because 
the  AFIT  Graduate  Management  curriculum  was  designed  for 
specific  requirements.  Therefore,  the  educational  needs 
determination  effort  had  to  be  tied  to  the  specific  needs 
of  GL  positions. 

Although  other  educational  institutions  may  have 
less  well-defined  target  populations,  the  researchers  are 
confident  that  target  population  information  is  available. 
Alumni  data,  alumni  surveys,  surveys  of  specific  types  of 
organizations,  and  surveys  of  groups  of  similar  organiza- 
tions are  all  potential  sources  of  educational  needs  data. 
For  example,  a survey  of  the  eight  largest  accounting 
firms  or  of  USAF  Auditor  General  organizations  could  be 
designed  to  describe  the  financial  management  techniques 
required  for  supervisory  auditor  positions. 

In  the  previous  communications  example,  the  use 
of  goal  analysis  and  task  analysis  was  considered  poten- 
tially useful.  In  this  case,  the  researcher  would  use  goal 
and  task  analysis,  but  modify  the  data  collection  plan 
to  include  only  those  positions  which  require  the  use  of 
a program's  graduates.  For  example,  the  graduates  of  the 
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Squadron  Officer  School  may  ultimately  be  assigned  to  any 
USAF  officer  position;  therefore,  the  data  collection  plan 
would  involve  a sample  of  all  USAF  officer  positions. 

Suggestions  for  Research 

The  first  step  of  the  ISD  Model  has  been  accom- 
plished; the  researchers  recommend  a continuing  effort  to 
apply  the  remaining  steps  of  the  ISD  Model  for  the  AFIT 
School  of  Systems  and  Logistics'  financial  management 
course.  The  next  step  of  the  ISD  Model  will  define  educa- 
tion requirements  by  identifying  what  instruction  is  neces- 
sary and  deciding  which  instruction  methods  and  resources 
to  use  in  providing  the  education.  The  remaining  steps 
develop  education  objectives,  plan  the  instruction,  and 
evaluate  the  instruction  provided. 

Now  that  the  financial  management  techniques 
required  in  GL  positions  have  been  identified,  other 
research  projects  could  utilize  this  data  base  for  other 
purposes.  The  same  survey  instrument  could  be  used  to 
determine  if  non-GL  positions  required  the  same  financial 
management  techniques.  If  so,  the  subjects  may  be  more 
useful  in  a Professional  Military  Education  curriculum 
rather  than  in  the  graduate  curriculum.  Other  curricula 
could  use  the  same  survey  instrument  to  determine  if  the 
financial  management  techniques  should  be  taught.  Finally, 
the  researchers  believe  the  sampling  and  survey  techniques 
used  in  this  research  project  could  be  used  to  improve  data 
collection  for  USAF  Technical  Training  ISD  projects. 
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SURVEY  RESPONSE1 


Original  Survey  Response 


Week 

Scored 

Not  Scored 

Total 

1 

9 

1 

10 

2 

41 

5 

46 

3 

7 

4 

11 

4 

5 

0 

5 

5 

4 

1 

5 

6 

0 

0 

0 

Total 

66 

11 

77 

Follow-Up 

Survey  Response 

Week 

Scored 

Note  Scored 

Total 

1 

5 

4 

9 

2 

20 

4 

24 

3 

6 

2 

8 

Total 

31 

10 

41 

'Four  follow-up  responses  were  received  in  the 
fourth  week  and  two  follow-up  responses  were  received  during 
the  fifth  week.  Since  these  six  responses  were  received 
after  the  three-week  acceptance  cut  off,  they  were  not 
scored. 
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Response 

Rate 

Scoring 

Rate 

Original 

50% 

86% 

Follow  Up 

46 

76 

Overall 

77 

82 
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BINOMIAL  TEST 

The  binomial  test  described  by  Siegel  (52:36-42) 
was  used  to  indicate  statistically  significiant  use  of 
specific  financial  management  techniques.  Responses  were 
coded  in  two  categories — 0 for  not  part  of  the  job  and  1 
for  all  parts  of  the  job  between  1 and  7 on  the  job 
proportion  scale. 

The  hypothesis  test  is  constructed  as  follows: 

Hq : P = Q = 1/2 
H1:  Q > P 

and  will  be  tested  at  a 90  percent  confidence  level. 
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P = Probability  of  0 
Q = Probability  of  2 

CF  = X+.5  for  X less  than  UP  and  CF=X-.5 
for  X greater  than  /VP 
N = Number  of  responses 

The  hypothesis  tests  were  resolved  using  Siegel's 
Table  D (52:250)  when  the  number  of  cases  was  less  than 
twenty-five  or  a critical  Z value  {-1.28)  for  more 
than  twenty-five  cases.  For  all  cases,  the  following 
decision  rule  was  used  to  evaluate  the  binomial  tests: 

If  the  test  statistic  (Z)  is  less  than  a 10  percent  cri- 
tical value,  sufficient  evidence  does  not  exist  to  reject 
HqJ  therefore,  the  use  of  a specific  financial  management 
technique  is  not  supported  by  statistical  evidence.  The 
importance  subjects  associate  with  specific  techniques 
and  the  number  of  people  who  use  a technique  are  addi- 
tional factors  which  may  influence  the  educator's  judg- 
ment . 
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SIGNIFICANT  CATEGORIES* 


Significance  determined  by  application  of  the  Binomial  Test. 
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APPENDIX  C 

FINANCIAL  MANAGEMENT  TECHNIQUES 
AND  BEHAVIORAL  DESCRIPTIONS 


Goal  and  Task  analysis  were  used  to  develop  the 
financial  management  categories,  techniques,  and  beha- 
vioral descriptions  found  in  this  appendix. 
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APPENDIX  D 


l 

QUESTIONNAIRE 

The  cover  letter  for  the  original  survey,  the 
cover  letter  for  the  follow-up  survey,  and  the  survey 
instrument  are  contained  in  this  appendix.  The  follow-up 
instrument  was  identical  to  the  original  questionnaire. 


DEPARTMENT  OF  THE  AIR  FORCE 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY  IAUI 
WRIGHT-PATTERSON  AIR  FORCE  BASE.  OHIO  45433 


SEiioJ?  SLG  (Capt  Fulton/AUTOVON  7 8-72  527) 

subject:  Financial  Management  Utilization  Questionnaire 


78 


TQ: 


1.  The  purpose  of  the  attached  questionnaire  is  to_ deter- 
mine the  financial  management  tasks  used  in  facilities, 
logistics,  and  procurement  advanced  academic  degree  coded 
positions.  Headquarters  USAF  Survey  Control  Number  76-134 
has  been  assigned  to  this  questionnaire. 


2.  Participation  is  voluntary  and  you  may  remain  anonymous 
by  not  providing  your  name.  Your  cooperation  is  important 
because  the  data  you  provide  will  be  used  to  improve  logis- 
tics education  programs.  If  you  choose  to  participate, 
please  return  the  questionnaire  in  the  attached  envelope 
within  , one  week  of  receipt.. 


2 Atch 

1.  Questionnaire 

2.  Return  Envelope 


HENRY^w.  PARLE TT , Colonel,  USAF 
Associate  Dean  for  Graduate 
Education 

School  of  Systems  and  Logistics 


Strength  Through  Knowledge 


DEPARTMENT  OF  THE  AIR  FORCE 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY  I AU  I 
WRIGHT-PATTERSON  AIR  FORCE  BASE.  OHIO  4S433 
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REPLY  TO 

attmof.  SLG  (Capt  Fulton/AUTOVON  78-72527) 


1?  JUL  197R 


subject:  Financial  Management  Utilization  Follow-up  Questionnaire 


TO: 

1.  The  purpose  of  the  attached  questionnaire,  HQ  USAF  Survey  Control 
Number  76-134,  is  to  determine  the  financial  management  tasks  used  in 
facilities,  logistics,  and  procurement  advanced  academic  degree  coded 
positions . 

2.  This  questionnaire  is  being  sent  as  a follow-up  to  all  positions 
for  which  responses  were  not  received  by  9 July  1976.  If  the 
response  for  your  position  has  been  returned,  please  disregard  this 
letter.  In  addition  to  your  questionnaire  responses,  the  researchers 
are  interested  in  the  reasons  why  the  first  questionnaire  was  not 
returned.  This  information  would  be  used  in  validating  the  question- 
naire as  a method  of  data  collection. 


3.  Participation  in  this  research  effort  is  voluntary  and  you  may 
remain  anonymous  by  not  providing  your  name.  If  you  choose  to 
participate,  please  provide  the  requested  background  information  to 
verify  that  the  survey  reached  the  intended  position  and  return  the 
questionnaire  in  the  attached  envelope  within  one  week  of  receipt. 

Your  participation^ in  this  research  effort  will  be  greatly  appreciated. 

HENRY  W.  PARLETT,  Colonel,  USAF 


Associate  Dean  for  Graduate 
Education 

School  of  Systems  and  Logistics 


2 Atch 

1.  Questionnaire 

2.  Return  Envelope 


Strength  Through  Knowledge 


f. 
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FINANCIAL  MANAGEMENT  UTILIZATION  QUESTIONNAIRE 

This  survey  is  being  administered  to  an  Air 
Force-wide  sample  of  officers.  As  a result,  the  questions 
are  not  worded  in  specific  terms  and  may  not  contain  the 
specific  technical  terms  used  in  your  job.  We  are  not 
trying  to  describe  your  entire  job — we  are  only  interested 
in  the  part  of  your  job  which  could  be  loosely  described  as 
financial  management.  This  survey  should  take  no  more  than 
20  minutes  of  your  time. 

Please  complete  the  background  information  in  Part 
I of  the  questionnaire.  Your  name  is  not  required.  The 
background  information  will  be  used  to  confirm  that  the 
survey  reached  the  intended  people.  After  completing  the 
background  information,  read  the  instructions  for  Part  II 
of  the  survey. 


USAF  SCN  76-134 


L 


I 


PRIVACY  STATEMENT 


In  accordance  with  paragraph  30,  APR  12-35,  the  follow- 
ing information  is  provided  as  required  by  the  Privacy  Act 
of  1974: 

a.  Authority: 

(1)  10  U.S.C.,  80-12,  Secretary  of  the  Air  Force , 
Powers,  Duties,  Delegation  by  Compensation ; and/or 

(2)  EG  93-97  , 22  Nov  43,  Nur.be ring  Sys ten  f oj 
Federal  Accounts  Relating  to  Individual  Persons ; and/cr 

(3)  DOD  Instruction  1100.13,  17  Apr  68,  Surveys 
of  Department  of  Defense  Personnel;  and/or 

(4)  AFR  178-9,  9 Oct  73,  Air  Force  Military 
Survey  Program. 

b.  Principal  purposes.  The  survey  is  being  conducted 
to  collect  information  to  be  used  in  research  aimed  at 
illuminating  and  providing  inputs  to  the  solution  of  prob- 
lems of  interest  to  the  Air  Force  and/or  DoD. 

c.  Routine  Uses.  The  survey  data  will  be  converted 
to  information  for  use  in  research  of  management  related 
problems.  Results  of  the  research,  based  on  the  data  pro- 
vided, will  be  included  in  written  master's  theses  and  may 
also  be  included  in  published  articles,  reports,  or  texts. 
Distribution  of  the  results  of  the  research,  based  on  the 
survey  data,  whether  in  written  form  or  presented  orally, 
will  be  unlimited. 

d.  Participation  in  this  survey  is  entirely  voluntary. 

e.  No  adverse  action  of  any  kind  may  be  taken  against 
any  individual  who  elects  not  to  participate  in  any  or  all 
of  this  survey. 
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PAST  I 


NAME  ( optional )_ 
RANK 


DUTY  TITLE 

DAFSC 

LEVEL  OP  ASSIGNMENT  (HQ  AP, 

ORGANISATION 

BASE  

MA JC QM 

MONTHS  IN  PRESENT  POSITION_ 
POSITION  NUMBER 


MAJCOM , 


NAP , ETC . ) 


i A 

i. 
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FART  II 

This  part  of  the  survey  lists  4-6  tasks  which  may  he 
required  in  your  present  job.  After  you  have  read  the 
tasks,  you  will  be  asked  to  rate  each  task  twice — once  for 
the  relative  proportion  of  your  job  the  task  represents 
and  once  for  the  importance  you  place  on  the  cask.  Space 
uas  been  provided  at  the  end  of  the  task  iisc  for  your 
comments . 

Please  return  the  completed  questionnaire  within 
five  work  days.  Thank  you  for  your  cooperation. 
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JOB  PROPORTION  SCALE 

Please  rate  each  task  in  PART  2 according  to  the 
relative  proportion  of  your  job  represented  by  the  task. 
Use  the  following  scale: 

0 NOT  PART  OF  MI  PRESENT  JOB 

TrY'rr''DT7’7TTr'*'  V c\"  DfDm  77!  Y\r  T ^ -n 

Li  A » Jlull  ut'uujij  X'AllT  vJ.T  iTl  O 0l3 

3 A SMALL  PART  OF  MI  J03 

4 A MODERATE  PART  OF  MI  JOB 

5 A LARGE  PART  OF  MI  JOB 

S A ’PERI.  LARGE  PART  OF  MI  JOB 

7 AN  EXTREMELY  LARGS  PART  OF  MI  JOB 

Circle  7 for  tasks  comprising  the  largest  part  of 
your  job.  Circle  6 for  tasks  comprising  the  next  largest 
part  of  your  job  and  so  on  with  0 for  tasks  not  part  of 
your  job. 
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JOB  IMPORTANCE  SCALE 

Please  rate  each  task  in  PART  2 according  to  the 
relative  importance  you  place  upon  the  task.  Use  the 
following  scale: 

0 NOT  PART  OF  MY  PRESENT  JOB 

1 VERY  LOW  IMPORTANCE 

2 A LITTLE  BELOW  AVERAGE  IMPORTANCE 

3 AVERAGE  IMPORTANCE 

4-  A LITTLE  ABOVE  AVERAGE  IMPORTANCE 

5 VERY  HIGH  IMPORTANCE 

^rc-‘-e  5 for  tasks  you  rank  highest  in  importance, 
circle  L for  tasks  of  next  highest  importance  and  so  on 
wi^h  w for  tasks  not  part  of  your  present  job. 
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TASKS 


1.  Participate  in  the  preparation  of  an  operating  or 
spending  plan  for  an  Air  Force  Stock  Fund  division. 

0 12  3 4 5 6 7 012345 

(Proportion)  (Importance) 


2.  Participate  in  the  preparation  of  an  operating  or 
spending  plan  for  an  Air  Force  Industrial  Fund. 


01234567  012345 

(Proportion)  (Importance) 

3.  Determine  cost  and  volume  relationships. 

01234567  0 12345 

(Proportion)  (Importance) 

4.  Sequence  alternatives  based  only  upon  total  cost. 


0 1 2 3 4 5 6 7 
(Proportion) 

5.  Sequence  alternatives  based 
urgency  of  mission  requirements. 

01  234567 
(Proportion) 


0 1 2 3 4 5 
(Importance) 

upon  cost  and  the 


0 1 2 3 4 5 
(Importance) 


6.  Evaluate  or  prepare  alternative  proposals  by  sub- 
tracting total  anticipated  savings  from  total  anticipated 
cost. 

01234567  012345 

(Proportion)  (Importance) 

7.  Evaluate  or  prepare  alternative  proposals  by  divid- 
ing the  total  investment  by  anticipated  periodic  savings 
to  give  the  number  of  periods  required  to  cover  the  total 
investment. 


01234567  012345 

(Proportion)  (Importance) 

8.  Evaluate  or  prepare  alternative  proposals  by  divid- 
ing the  periodic  savings  amount  by  total  investment  to 
determine  an  interest  rate. 


01234567 

(Proportion) 


0 1 2 3 4 5 
(Importance) 
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9.  Evaluate  or  prepare  alternative  proposals  by  calcu- 
lating the  present  value  of  savings,  calculating  the  present 
value  of  investment  costs,  and  determining  the  interest  rate 
required  to  set  the  present  value  of  savings  and  the  present 
value  of  investment  costs  equal  to  each  other. 


0 1 2 ; 4 5 6 7 0 1 2 3 ^5 

(Proportion)  (Importance) 

10.  Evaluate  or  prepare  alternative  proposals  by  sub- 
tracting the  present  value  (PV)  of  the  investment,  and  PV 
of  operations  and  maintenance  costs  from  the  PV  of  savings. 

01234-567  0 1 2 )45 

(Proportion)  (Importance) 

It . Evaluate  or  prepare  alternative  proposals  using 
present  value  techniques  not  listed  in  this  questionnaire. 


01234-567  0 1 2 3 4 5 

(Proportion)  (Importance) 

12.  Evaluate  or  prepare  alternative  proposals  by  using 
a constant  dollar  index  to  adjust  historical  costs. 

01234-567  0123^5 

(Proportion)  (Importance) 

13.  Evaluate  unit  expenditures  compared  to  periodic 
targets. 


01234-567  012345 

(Proportion)  (Importance) 

14.  Evaluate  subordinate  units'  expenditures  compared 
to  periodic  targets. 

01234-567  C12345 

(Proportion)  (Importance) 

15.  Analyze  differences  between  planned  and  actual 
expenditures  to  isolate  potential  problem  areas. 

01234-567  012345 

(Proportion)  (Importance) 

16.  Determine  if  deviations  from  planned  expenditures 
are  caused  by  differences  between  planned  and  actual  price 
and/or  planned  and  actual  usage. 


01234-567 

(Proportion) 


0 1 2 3 4 5 
(Importance ) 
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I 

i 

i 
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17.  Evaluate  or  analyze  contractor's  financial  condition 
by  computing  various  ratios  based  upon  bis  financial  state- 
ments. 


0123455? 

(Proportion) 


0 1 2 3 4 5 

(Importance) 


18.  Evaluate  or  analyze  extractor's  financial  condition 
by  using  a statement  of  changes  in  financial  position,. 


01234567 

(Proportion) 


01  2345 

(Importance ) 


19.  Evaluate  or  analyze  contractor's  financial  condition 
by  examining  projected  changes  in  financial  statements. 


0^  23455 

(Proportion ) 


0 12  3 4 5 

(Importance) 


20.  Analyze  contractor  provided  data  on  costs  and 
schedules. 


0 1 234567 

(Proportion) 


01 2345 

(Importance ) 


21.  Participate  in  the  development  of  unit  budget 
estimates  for  IDT. 


0 1 2 3 4 5 6 7 

(Proportion) 


0 1 2 3 4 5 
(Importance) 


22.  Participate  in  the  development  of  unit  budget 
estimates  for  operations  and  maintenance. 


01 234567 

(Proportion) 


0 1 2 3 4 5 

(Importance ) 


23.  Participate  in  the  development  of  unit  budget 
estimates  for  equipment  items. 


01 234567 

(Proportion) 


0 1 2 3 4 5 

(Importance) 


24.  Participate  in  the  development  of  unit  budget 
estimates  for  military  construction. 


01234567 

(Proportion) 


0 1 2 3 4 5 

(Importance ) 


25.  Review  unit  budget  estimates. 


01  234567 

(Proportion) 


0 1 2 3 4 5 

(Importance ) 


m 
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26.  Review  budget  estimates  for  mission  support  adequacy. 


01 234557 

(Proportion) 


01  2345 

(Importance) 


27.  Review  budget  estimates  for  contingency  support 
adequacy. 


0 1 234567 

(Proportion) 


0 12  3 4 5 
(Importance) 


28.  Participate  in  the  budget  working  group  review  of 
budget  estimates. 


OQ 
*-  y ■ 


budget 


0^  2 3 4 5 6 7 

(Proportion) 

Participate  : 
estimates. 

0 1 2 3 4 5 6 7 

(Proportion) 


0 12  3 
(Importance) 


^ 4 5 


the  budget  review  panel  review  of 


0 1 2 3 4 5 
(Importance) 


30.  Provide  guidance  for  the  development  of  annual 
budgets  and  revisions. 


0 1 2 3 4 5 6 7 

(Proportion) 


0 1 2 3 4 5 
(Importance ) 


31.  Participate  in  the  consolidation  of  unit  budgets. 


01234567 

(Proportion) 


0 1 2 3 4 5 
(Importance) 


32.  Participate  in  NAJCOM  review  of  subordinate 
organization  budget  submissions. 


01234567 

(Proportion) 


01  2345 

(Importance ) 


33.  Participate  in  HQ  AF  review  of  MAJCOM  budget  sub- 
missions. 


01234567  012345 

(Proportion)  (Importance) 

34.  Participate  in  the  preparation  of  the  HQ  AF  "call" 
for  budget  estimates. 


01234567 

(Proportion) 


0 1 2 3 4 5 
(Importance) 
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Participate  in  the  preparation  of  MAJCOM  "call"  fo: 


budget  estimates. 


0 1 2 3 9-  5 6 7 
(Proportion) 


0 12  3 9-5 
(Importance) 


36.  Participate  in  the  analysis  and/or  submission  of 
Program  Objective  Memoranda. 


01239-567 

(Proportion) 


0 1 2 3 9-5 
(Importance) 


37.  Participate  in  the  analysis  and/or  responses  to 
Program  Decision  Memoranda. 


01  2 39-567 

U 1011 ) 


012395 

(Importance) 


38.  Participate  in  the  analysis  of  Joint  Force  Memo- 
randa. 


01239567 

(Proportion) 


0 1 2 3 9 5 
(Importance) 


Participate  in  the  analysis  of  the  Planning  and 


Program  Guidance  Memoranda. 

01239567 

(Proportion) 

90.  Serve  as  a resource  advisor. 

01239-567 

(Proportion) 

9-1 . Review  unit  expense  reports. 

01  239567 
(Proportion) 


0 1 2 3 9 5 
(Importance) 


0 1 2 3 9-5 
(Importance ) 


0 1 2 3 9 5 
(Importance) 


9-2.  Participate  in  the  analysis  of  Program  Budget 
Decisions. 


01  239567 

(Proportion) 


01  2395 

(Importance) 


93.  Participate  in  the  pricing  of  proposed  replacement 
items. 


0 1 2 3 9 5 6 7 

(Proportion) 


0 1 2 3 9 5 
(Importance) 
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44-.  Participate  in  the  pricing  of  expansion  of  capacity 
or  production  projects. 


0 12  3 4 5 6 7 
(Proportion) 


0 1 2 3 4 5 
(Importance) 


45. 

support 


Participate  in  the  pricing  of  acquisition  and 
costs  for  new  items. 


01  2 3 4 5 6 7 
(Proport ion) 

46.  Participate  in  the  pricing  of 
security,  and  other  plans. 


0 1 2 3 4 5 
(Importance) 

contingency,  safety, 


01  234567 
(Proportion) 


0 1 2 3 4 5 
\ -t-tao.  ip  0 ^ an  0 0 j 


47.  Now  that  you  have  completed  the  questionnaire, 
please  list  other  related  tasks  that  you  think  we  omitted 
from  the  questionnaire. 
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APPENDIX  E 

DEMOGRAPHIC  CHARACTERISTICS 

This  appendix  contains  population,  sample,  and 
respondent  demographic  data.  The  percentages  apply  to 
the  column  total.  For  example,  the  0046  AFSC  invited 
sample  size  is  23  percent  of  the  total  invited  sample 
size. 
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FINANCIAL  MANAGEMENT  TECHNIQUES  USED 
IN  GRADUATE  LOGISTICS  POSITIONS 


This  appendix  contains  the  financial  management 
techniques  required  in  GL  positions.  The  median  usage  and 
median  importance  associated  with  each  technique  are 
shown . 


FINANCIAL  MANAGEMENT  TECHNIQUES  USED  IN  GRADUATE  LOGISTICS  POSITIONS 
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APPENDIX  G 


CROSS-TABULATION  OF  JOB  PROPORTION  AND 
JOB  IMPORTANCE  RESPONSES 

This  appendix  contains  a cross-tabulation  of 
proportion  and  importance  responses  for  each  survey 
question.  The  rows  represent  the  relative  job  pro- 
portion which  the  task  represents,  while  the  columns  show 
the  relative  importance  associated  with  the  task.  For 
example,  the  table  for  question  1 shows  that  the  six 
respondents  who  indicated  that  the  task  represents  "an 
extremely  small  part"  of  the  job  also  associated  "a  very 
low  importance"  with  the  task. 
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PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO 


♦Participate  in  the  preparation  of  an  operating  or  spending  plan  for  an  Air 
Force  Stock  Fund  division. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  2* 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  4* 


Sequence  alternatives  based  only  upon  total  cost 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  5* 


*Sequence  alternatives  based  upon  cost  and  the  urgency  of  mission  requirements. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  7* 
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*Evaluate  or  prepare  alternative  proposals  by  dividing  the  total  investment  by 
anticipated  periodic  savings  to  give  the  number  of  periods  required  to  cover  the  total 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  8* 
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Evaluate  or  prepare  alternative  proposals  by  dividing  the  periodic  savings 
amount  by  total  investment  to  determine  an  interest  rate. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  9* 
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PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  10* 


♦Evaluate  or  prepare  alternative  proposals  by  subtracting  the  present  value  (PV) 
of  the  investment,  and  PV  of  operations  and  maintenance  costs  from  the  PV  of  savings. 


? CrP 
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prepare  alternative  proposals  by  using  a constant  dollar  index  to 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  13* 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  15* 
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differences  between  planned  and  actual  expenditures  to  isolate  poten- 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  16* 


♦Determine  if  deviations  from  planned  expenditures  are  caused  by  differences 
between  planned  and  actual  price  and/or  planned  and  actual  usage. 
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PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  18* 


*Evaluate  or  analyze  contractor's  financial  condition  by  using  a statement  of 
changes  in  financial  position. 
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PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  2 3* 


Participate  in  the  development  of  unit  budget  estimates  for  equipment  items. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  25* 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  26* 
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Review  budget  estimates  for  mission  support  adequacy. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  27* 


Review  budget  estimates  for  contingency  support  adequacy. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  29* 


Participate  in  the  budget  review  panel  review  of  budget  estimates. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  30* 


Provide  guidance  for  the  development  of  annual  budgets  and  revisions. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  31* 


I. 


Participate  in  MAJCOM  review  of  subordinate  organization  budget  submissions. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  33* 


♦Participate  in  HQ  AF  review  of  MAJCOM  budget  submissions. 


Participate  in  the  preparation  of  MAJCOM  "call"  for  budget  estimates. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  40* 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  41* 


10  0 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTON  NO.  43* 


♦Participate  in  the  pricing  of  proposed  replacement  items. 


PROPORTION  AND  IMPORTANCE  RESPONSES  FOR  QUESTION  NO.  45* 


*Participate  in  the  pricing  of  acquisition  and  support  costs  for  new  items. 


.Him*!.'. ^ -■■  — - 


Participate  in  the  pricing  of  contingency , safety,  security,  and  other  plans. 
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